ActiveSpaces: Exploring dynamic code deployment for extreme scale data processing
نویسندگان
چکیده
منابع مشابه
ActiveSpaces: Exploring dynamic code deployment for extreme scale data processing
Managing the large volumes of data produced by emerging scientific and engineering simulations running on leadership-class resources has become a critical challenge. The data have to be extracted off the computing nodes and transported to consumer nodes so that it can be processed, analyzed, visualized, archived, and so on. Several recent research efforts have addressed data-related challenges ...
متن کاملIn situ data processing for extreme scale computing
The DOE leadership facilities were established in 2004 to provide scientist capability computing for high-profile science. Since it’s inception, the systems went from 14 TF to 1.8 PF, an increase of 100 in 5 years, and will increase by another factor of 100 in 5 more years. This growth, along with user policies, which enable scientist to run at, scale for long periods of time, have allowed scie...
متن کاملOn Processing Extreme Data
Extreme Data is an incarnation of Big Data concept distinguished by the massive amounts of data that must be queried, communicated and analyzed in near real-time by using a very large number of memory or storage elements and exascale computing systems. Immediate examples are the scientific data produced at a rate of hundreds of gigabits-per-second that must be stored, filtered and analyzed, the...
متن کاملCode Generation Techniques for Raw Data Processing
The motivation of the current study was to design an algorithm that can speed up the processing of a query. The important feature is generating code dynamically for a specific query. We present the technique of code generation that is applied to query processing on a raw file. The idea was to customize a query program with a given query and generate a machine- and query-specific source code. Th...
متن کاملPrioritization method for non-extreme ecient unitsin data envelopment analysis
Super eciency data envelopment analysis(DEA) model can be used in ranking the performanceof ecient decision making units(DMUs). In DEA, non-extreme ecient unitshave a super eciency score one and the existing super eciency DEA models do notprovide a complete ranking about these units. In this paper, we will propose a methodfor ranking the performance of the extreme and non-extreme ecient units.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Concurrency and Computation: Practice and Experience
سال: 2014
ISSN: 1532-0626,1532-0634
DOI: 10.1002/cpe.3407